Mixed Reality Merging of Endoscopic Images and 3-D Surfaces
نویسندگان
چکیده
In image-guided neurosurgery, “mixed reality” merging has been used to merge video images with an underlying computer model. We have developed methods to map intra-operative endoscopic video to 3D surfaces derived from preoperative scans for enhanced visualization during surgery. We acquired CT images of a brain phantom, and digitized endoscopic video images from a tracked neuroendoscope. Registration of the phantom and CT images was accomplished using markers that could be identified in both spaces. The endoscopic images were corrected for radial lens distortion, and mapped onto surfaces extracted from the CT images via a ray-traced texture-mapping algorithm. The localization accuracy of the endoscope tip was within 1.0 mm. The mapping operation allows the endoscopic images to be permanently painted onto the surfaces. Our method allows panoramic and stereoscopic visualization from arbitrary perspectives (though the original endoscopic video was monoscopic) and navigation of the painted surface after the procedure.
منابع مشابه
Construction of an Immersive Mixed Environment Using an Omnidirectional Stereo Image Sensor
Recently virtual reality (VR) systems have been incorporating rich information available in the real world into VR environments in order to improve their reality. This stream has created the field of mixed reality which seamlessly integrates real and virtual worlds. This paper describes a novel approach to the construction of a mixed environment. The approach is based on capturing the dynamic r...
متن کاملMerging range images of arbitrarily shaped objects
Range data ooer a direct way to produce shape descriptions of surfaces. Typically single range images have the form of a graph surface z = g(x; y) and thus suuer from occlusion. One can reduce this problem by taking several images from diierent locations and merging them together. The result is a real 3-D description of the object's surface. In this paper we address several problems that result...
متن کامل4 + 4 Fingers Manipulating Virtual Objects in Mixed-Reality Environment
This paper describes the construction of a prototype system that allows the user to manipulate virtual objects in a mixed-reality environment. The user can perceive haptic sensations at his or her fingertips and see a virtual world with a live image of his or her hands manipulating the virtual objects. The difficulty of constructing such a visual presentation is the problem of merging the real ...
متن کاملDense Estimation of Surface Reflectance Properties for Merging Virtualized Objects into Real Images
To appropriately reproduce a real object in a mixed environment, it is necessary to estimate reflectance properties of object surfaces. This paper describes a new method of densely estimating non-uniform surface reflectance properties of an object with convex and concave surfaces using registered range and surface color texture images obtained by a laser rangefinder. The proposed method determi...
متن کامل